"The important tokens are primarily Thai morphemes, syllables, or word fragments, often marking the core of nouns, verbs, or key modifiers. These tokens frequently appear at the start or within compound words, proper nouns, or technical terms, and are often associated with semantic content or grammatical function, such as denoting objects, actions, or attributes. The activations highlight meaningful subword units that contribute to the overall meaning and structure of the sentence."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.71 | 1.0 | 0.42 | 0.592 | 0.42 | 1.0 | 0.0 | 0.58 |
fuzz | 0.76 | 0.933 | 0.56 | 0.7 | 0.56 | 0.96 | 0.04 | 0.44 |